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1. Introduction and statement of main results 
1.1. Introduction 

Let {Zi)i>i be a independent, identically distributed sample taking values in K.''. 
Since the pioneering works of Stutc (1982), several researchers have investigated 
the limit behaviour of the functional increments of the empirical process, which 
are defined as follows, for fixed h > and z GMf^: 

Aa„(-, /i, z) : ,SK^ (^.0 - P(^i e[z,z + hl/^s]j^ , s e [0, 1]^'. 

Here we write [a, b] := [oi, 6i] x • • • x [ad, bd] for a,b G M.'^. Dehcuvels and Mason 
(1992) have provided a uniform functional limit law (UFLL) for the following 
collections of functional increments: 

e; z), ze[0,l- m}, (D 

when d = 1, Zi is uniform on [0, 1] and hn satisfies the Csorgo-Rcvcsz-Stute 
(CRS) conditions (see (HV1)-(HV3) below). Implicit in their result is the UFLL 
for Qn when {Zi)i>i take values in R and have a density / that is continuous 
and strictly positive on an open set O, and when z appearing in (1) ranges in a 
bounded interval H <Z O. However, the extension of this result to the multivari- 
ate case {dil) remained an open problem for almost a decade. Recently, Mason 
(2004) (see also Einmalil and Mason (2000)) solved this problem by combining 
the techniques of Dehcuvels and Mason (1992) with recent tools in general em- 
pirical process theory. Namely, he obtained asymptotic results in a more general 
framework, considering the following type of stochastic processes indexed by K: 



g„(a-,/.,.)=x:Kt^)-K^(tv^)) 



(2) 



Here, K ranges through a class of functions Q satisfying some conditions that will 
stated later (see (HK1)-(HK5) in the sequel). More precisely. Mason established 
a UFLL for the following the sets of processes, as n ^ cx), 

" \^2f{z)nK\og{l/Ky 

where iJ is a compact set of with nonempty interior. To cite his result, we 
have to recall the basic assumptions made in Mason (2004). 

We say that a sequence of constants satisfies the Csorgo-Revesz-Stute (CRS) 
conditions whenever 
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(HVl) /i„ i 0, < hn < 1, nhn T oo, 
(HV2) lim 7i/i„/ logji = oo, 

n — >oo 

(HV3) lim log(l//i„)/loglogn = oo. 

n — >oo 

Let Q he & class of real Borel functions on W^. Set I'^ :~ [0, 1]'' and 

T {a'(A(- - z)), z e M'', A > 0, K e g}. 

Let II • lljjd be the euclidian norm on W^. We make the following assumptions 
on Q. 

(HKl) lim sup / {K{x)~ K{x + u)fdx = Q, 

lim sup / {K{Xx) - K{x)fdx = 0, 

(HK2) VA G sup I K{x) \< 1, 

(HK3) eg,Vx(^ /\ (x) = 0, 

(HK4) 3Co > 0, Wo > 0, Ve e (0, 1), 7V(e, J^) < Coe-^o. 



Here, Af{e,J-) denotes the uniform covering number of J- for e and the class 
of norms {L2{P)}, with P varying in the set of all probability measures on R'', 
and taking the F = 1 as an envelope function for the class (for more details, 
see Van der Vaart and Wellner (1996), p. 83-84, with r = 2). To overcome any 
measurability problem, we make the following assumption. 

{HK5) T is pointwise separable (see Van der Vaart and Wellner (1996), 
p. 110-111). 

Let L\{Q) be the Hilbert subspace of ^2(1^'', A) spanned by Q, where A denotes 
the Lebesgue measure on W^. The (rate) function J that rules the large deviation 
properties of the isonormal Gaussian process generated by (L2(5),A) can be 
defined, for a function 5* : t-* R, by 

J(vl/) := inf J y g^d\ g e L*(g), V/^ G ^{K) = J gKdxV 

with the implicit convention inf = 00. Now set K = Kg := : J(5') < 1}. 
Let B{G) be the set of all real bounded functions on Q. Denote by | • Id the usual 
max norm on R'', namely 

I z |d:= .max | Zj | . (3) 

j = l,...,d 

We make a last assumption upon the law of the Zi (recall that is a compact 
set with nonempty interior). 

(H f) There exists a such that Zi has a density / that is continuous and 
strictly positive on the set 
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{zeM^': m£|z-y |d<a}. (4) 

Under all the above assumptions, Mason established the following result. 

Theorem (Mason, 2004). Let H he a compact subset of with nonempty 
interior. Let {Zi)i>i be an i.i.d. sequence of random variables satisfying (H f). 
Let {hn)n>i be a sequence of constants fulfilling (HV1)-(HV3) and let Q he 
a class of real Borel functions satisfying (HK1)-(HK5). Then we have almost 
surely: 



[i) lim sup inf 



Gn{-, z, hn) 



{a) e K, lim inf 

n—>oc z£H 



(2/(z)n/i„log(l//i„))'^' 

Gn{': Z, hn) 



0, 



(2/(z)n/i„log(l//i„)) 



1/2 



0. 



The author proved this result by combining the ideas of Einmahl and Mason 
(2000) with some recent results in large deviation theory (see Arconcs (2003, 
200)), Gaussian approximation results for finite dimensional laws 
(Zaitsev (1987a,b)) and sharp bounds for empirical processes (see Talagrand 
(1994), or Bousquct (2002) and Klein (2002) for sharper bounds). In the present 
paper, we show that the arguments of Mason can be efficiently used to enrich 
his theorem with an additional uniformity in G [/in, fin]; under some mild 
conditions. The remainder of this article is organised as follows. The main re- 
sult is given by Theorem 1 in §1.2. The proof follows in §2 and is divided into 
two parts. In §2.1 we sate a large deviation result and a concentration inequal- 
ity. These two results are somewhat straightforward in regard to the works of 
Arconcs (2003) and Einmahl and Mason (2000). They will play a crucial role in 
our proof of Theorem 1, which is written in §2.2. 

1.2. Statement of the result 



We provide in the present paper an extension of the just mentioned theorem 
of Mason (2004) showing that his UFLL still holds uniformly in ft,„ < ft, < ()„, 
provided that both {hn)n>i and (f)„),i>i satisfy (IIV1)-(IIV3). 

Theorem 1. Let H be a compact subset of M."^ with nonempty interior. Let 
{Zi)i>i he an i.i.d. sequence of random variables satisfying (H f). Let {hn)n>i 
and (f)n)n>i be two sequences of positive numbers satisfying (HV1)-(HV3) as 
well as ()„ > 2hn. Then we have almost surely: 



(i) lim sup inf 



G'„(-, h, z) 



(ii) V* e 



lim sup inf 

h„<h<t,„ 



^2f{z)nh\ogil/h) 
G„{-,h,z) 



0, 



y/2f{z)nh\og{l/h) 



G 
- * 



= 0. 



Sketch our proof: Roughly speaking, our proof is divided into the following 
steps: 
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• The proof of Mason can be very crudely summed up as follows: given 
properly chosen sequences of events (£'n(e, ^n))ri>i, he proves that, for 
fixed e > we have, for all large n 

P{Enie,K)) <hl (5) 

for some ^ > 0. Then he makes use of the fact that {hn)n>i satisfies condi- 
tions (HV1)-(HV3) to achieve his goals, by making use of usual blocking 
techniques along with the Borel-Cantelli lemma. 

• Given p > 1, we discretise [hn,l)n] into the following grid of size i?„ « 
log(f)„//i„)/log(p): 

{hn,0, hnS, hn,2 ■ ■ ■ , ^Ti,i?,„} = {hn, ph„, P^hn, ■ ■ ■ , i)n} ■ (6) 

• For fixed e, we show that P(£'„(e, ft.„_;)) < hf^ ^ uniformly in I, for some 
(5 > 0. To do this, we make use of argument that are very similar to those 
of Mason for proving (5), but taking additional care to get inequalities 
uniformly in / (see our key argument in §2.2, Step 1). Indeed, we had to 
write an concentration inequality (see Proposition 2.2), which is somehow 
a finite distance version of the inequality used by Mason. 

• Then we write, A„ denoting a term of oscillation of our proceses between 
two consecutives /i„^;, 

U E^ie,h)] <¥f\jE^{e,Kj)\+A^ 

1=0 1=0 ^ 



Thus, we can make use of the fact that {i)n)n>i satisfies (HV1)-(HV3) and con- 
tinue our proof as in the proof of Mason. The oscillation term A„ is controlled 
by the concentration inequality of Proposition 2.2. We now focus on some corol- 
laries of Theorem 1. Denote by gn,h,z a non usual form of functional increments 
of the empirical process, namely: 



i=l ^ ^ ^ ^ ' ' 

with the notation [s, 1] := [si, 1] x • • -x [s^, 1], s = (si, . . . , s^) G [0, 1]''. Applying 
Theorem 1 respectively to the particular class of indicator functions of the sets 
[s, 1], s e [0, 1]'', we obtain, almost surely: 



lim sup sup inf J \\ gn,h,z - 9 1 1 [0.1]''= 0, (8) 

— helh„,t,„] zenaesV 2/(z) log(l//i) 



71— »00 



VgeS, lim sup '^^i \ — ttjtt W 9n,h,z - 9 \\[oa]''= 0, (9) 
/«e[/i„,f)„l ^eff y 2/(z) log(l//i) 
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where || g ||[o, sup{| g{s) |, s G [0, l]*^}, and where 5 stands for the following 
Strassen type set of functions mapping [0, 1]'' to M: 

g:s^ I g{u)du, for some function 5 fulfilling / g(u)^du.>. 



S] "'[0,1]'' 

Denote by fn{K, h, z) the Parzen- Rosenblatt density estimator, namely 



(10) 



i=l ^ 

The main interest of deriving (8) and (9) from Theorem 1 is that it enables us 
to straightforwardly derive asymptotic confidence bands for fn{K, h, z) that are 
uniform in ft, € ()„], which is the subject of the following corollary. 

Corollary 1.1. Let K he a kernel with compact support and hounded variation. 
If both {hn)n>i and (t)n)n>i do satisfy assumptions (HV1)-(HV3), then we have 
almost surely 

V^(fn{K, h, z) - E(f„{K, K z))) 
lim sup sup ^ = ^ = I K'^dX. 



V n 

lim inf inf 



^21og(l//i)/(z) ^ 
h(^fn{K,h,z)-E(^f^{K,z,h) 



woo h&lh„,t,^] zGH ^y2\og{l/h)f{z) ^ 



R-^dX. 



Proof. By a change of scale, we can assume that K has his support included in 
[0, l]**. Define the following application that maps the space of all bounded real 
functions on [0, 1]'' to M: 



TZ: g^ J g{s)dK{s) 



[OS]'' 

Obviously TZ is continuous with respect to || • ||[o,i]£i, since K has bounded 
variation. Noticing that, by an integration by parts, we have 

fniK,h,z)^E{f,,iK,h,z)) ^ J gn{s)dK{s), (11) 

[o,i]rf 

we readily infer the claimed result, by optimising TZ on the limit set S. We omit 
details. □ 

In order to state our next corollary, we need to introduce some more notations. 
Given a positive random variable /i* , we define 



E 



[f4K, z, h*S) ■■= I K (J-^^ dF^^ iu). (12) 
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Corollary 1.2. Let /i* be a sequence of positive random variables satisfying, 
with probability one: 



< liminf 

n — >oo 



log(l/fe») 
logri 



< limsup 



l0g(l/fen) 

logn 



< 1. 



Then we have almost surely 

^A<(/„(i^, z, hi) - i(/„(A', z, hi))) 



lim sup ■ 



lim inf ■ 



V21og(l//i;)/(z) 
TK[fn{K, z, hi) - E(/„(if, Z, 



^2\ogil/hl) f{z) 



\ 



K^dX. 



(13) 



(14) 



(15) 



Proof. The proof is a direct consequence of corollary 1, by manipulating the 
following countable collection of events 



< hi < for all large n}, r,r' eQn [0, 1]. 



We omit details. 



□ 



Remark 1. Corollaries 1.1 and 1.2 should be compared to Theorem 1 of 
Einmahl and Mason (2005). Our results rely on assumptions that are stronger 
than those stated in Einmahl and Mason (2005). However, we derive uniform 
rates of convergence that are exact and explicit. 

Remark 2. Several data-driven bandwidths have a well-known asymptotic limit 
behavior. Typical examples are the bandwidth selectors of Park and Marron (see 
Park and Marron (1985)) and of Sheather and Jones (see Sheatlior and Jones 
(1991)). But the almost sure limit behavior of hi is seldom known. However, 
limits in probability are often provided in the literature. For example, it has 
been proved (see Park and Marron (1985)) that the bandwidth selector /i* ^ of 
Park and Marron satisfies, under mild conditions, 

V hnM J 

Here Op(l) means that the sequence is bounded in probability, and h„^o is the 
(deterministic) minimizer of 



E 



{fn{x)-f{x))^dx).. 



which in turn is equivalent to Cn~^/^ for some constant C. Despite such type 
of asymptotic results for /i* do not meet the requirements of corollary 1.2, it is 
possible to adapt the latter corollary to derive weaker versions of (14) and (15), 
which hold in probability instead of almost surely. 
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2. Proof of Theorem 1 
2.1. The main tools 

Our proof of Theorem 1 relies on two crucial tools. First we shall make use of a 
criterion in large deviation theory for functional spaces. This criterion, which is 
mostly due to Arconcs (2003), is stated in § 2.1.1. We shall also make use of a 
concentration inequality (se Proposition 2.2) which is proved by borrowing the 
arguments of Einnialil and Mason (2000). 

2.1.1. Uniform large deviation principles 

In the proof of Theorem 1, we shall require large deviation results that arc uni- 
form in the rows for triangular arrays of processes. This required uniformity 
leads us to first state a result that can be straightforwardly derived from The- 
orem 3.1 of Arcones (2003). In the sequel, {en,i)n>i,i<p„ will always denote a 
triangular array of positive numbers satisfying lini„^oo niaxi<j,^ e„.i = 0. Given 
a set T, B{T) will denote the space of bounded real functions on T. We shall 
endow this space with the usual sup- norm || • ||t. Let {E,d) be a topological 
space. A real function J : E ^ is said to be a rate function (implicitly for 
when the sets of the kind {x € E : J{x) < a}, a > 0, are compacts 
sets of (E^i!)). Finally, let (-^n.i)„>]^ j<p be a triangular array of random el- 
ements (not necessarily Borel) taking value in E. We say that {Xn.i)^^^^ 
satisfies the uniform large deviation principle (ULDP) for the triangular array 
fcn i) and the rate function J whenever 

• For any open set O e T we have 

liminf mine„.,log(P,(X„, G O)) > -J{0). 

• For any closed set G T we have 

limsupmaxe„,aog(P*(X„.,(-) € F)) < -J{F). 

Remark 2.1.1. 

When referring to outer and inner probabilities P* and P*, one should take 
care of the underlying probability space, which is taken to be the canonical 
probability space in our context. 

By assumption {HKb) we shall only manipulate true probabilities in our 
proof of Theorem 1. The following result, which can be seen as a direct corollary 
of Theorem 2.1 of Arconcs (2003), will be used when establishing Proposition 2.3 
in the sequel. 

Proposition 2.1. Let (A'„.i)„>i. i<p^ he a triangular array of random elements 
of B{T), and let be a triangular array of positive numbers. Sup- 

pose that the following conditions are satisfied. 
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1. There exists a semi distance p on T that makes T totally bounded. 

2. For any p > I, and {ti, . . . ,tp) G W , the triangular array of random vari- 
ables (X„,i(ii), . . . , X„,i(tp))^>^ satisfies the ULDP for (e„, ,)„>!, i<p„ 
and a rate function Jti....,tp on MP. 

3. For any a > and M^O, there exists rj > such that 



limsupmaxe„_ilog(P*( sup \Xn,zit) - Xn,iis)\ > a)) < -M. 

(16) 

Then (X„_i(-))„>i_ i<p„ satisfies the ULDP in {B{T), \ \-\\t) for (e„^i)„>i, i<p„ 
and the following rate function 

:= sup |jt„...,t^(*(ti),...,*(tp))}, *e6(T). 

p>l, (ti,...,tp)GKP 

Proof. The proof is a direct copy of the proof of Theorem 2.1 in Arcones (2003), 
replacing P*(J7„ G F) < . . . by maxj<p„ P*(X„,» e i^) < . . . and P*(;7„ S O) > 
. . . by min,i<p,^ P*(X„_i G O) > . . and so on. We avoid writing the proof for 
this reason. □ 



2.1.2. A concentration inequality 
For any real Borel function g we set 

n 

Tn{g) =Y.9{Z^) - E(5(Z,)), g€T. (17) 

1=1 

The following concentration inequality for local empirical processes will play a 
crucial role in the sequel. It states a somewhat finite distance version of the 
arguments of Einmahl and Mason (2005). 

Proposition 2.2. Let T be a class of functions on R*^ with measurable envelope 
function F satisfying, for some constants r > and h € (0, 1), 

sup Var(.g(Zi)) < r^h. 

Assume that there exists C, Pq > and p > 2 fulfilling, for all < e < I, 

A/'(e,^) <Ce-\ 
E{F{Yf) </32. 

Then there exists a universal constant A2 > and a parameter Di(v) > 
depending only on v such that, for fixed po > 0, p > 2 and Sq, if h > satisfies 

Ci := maxjl, (4<5oxA^/r) , (po-Jq/t^) ''^-'I- } < , (18) 
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C2 := niin|l/r^/3o, T^} > h and 
sup \g{z) \<5o{^nh/\og{l/h)Y/P, 



(19) 
(20) 



then we have 



»( max II ||^> {T + po)Di{nh\og{\lh)Y'^ 



<4exp -A^P^ \og{l/h) 



Proof. By (18) and (20) we have 



sup 

gee, zef 



nh 



log(l//i) 



i/p 



<- 



1 



riT^h 



<- 



^2V^7TTV 21og(l//i) 

1 / 



2/1 



"2^A7TTV log(/?oVl/r2;i)- 



(21) 



Here, (21) is a consequence of (19). 

Denote by (ei)i>i an i.i.d. sequence of random variables independent of 
{Zi)i>i with P(ei = ±1) = 1/2. Applying Proposition A. 2 of Einmahl and Mason 
(2000) with (3 :~ (3q and cr^ ^-^j^ t^jq ggt, for a universal constant > 0, 

tin{^) :=E sup Y]eig(Z,) 

\S^^ ' ^=l 

wnr^/i log(l/T2/i) 
<\/2^A3TVri/ilog(l//i). (22) 

We shall now apply inequality A.l in Einmahl and Mason (2005). According to 
the notations of that inequality, we choose M := So{nh/ \og{l/ h)y^P . We then 
have, writing Di := max{j4i, j4i^3'\/2w}, 



<1 



<2 



(max II ||^> {T + po)Di{nh\ogil/h))^^^ 

\l<m<n 

II Trn \\:f> Ai(^po{nhlogil/h)y^^ + fi„{T) 

A2Po(n/llog(l//l))l/2 



max 

l<m<n 



exp 



<4cxp 



A2plnh\og{l/h) \ 
nr'^h J 

#log(l//.) 



exp 



5o{nh/ logil /h)y/p 



(23) 

(24) 
(25) 



Here, (24) is a direct application of inequality A.l in Einmahl and Mason (2005), 
while inequality (25) is a consequence of (18). This concludes the proof of Propo- 
sition 2.2. □ 
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2.2. Proof of part (i) of Theorem 1 

We will make repeatedly use of the following obvious argument: 

sup/(z)-i/2 =: /3 < oo. (26) 

First select e > arbitrarily. We claim that, almost surely, 

G„(-,/i, z) 



lim sup sup inf 

n^oo h„<h<t)„, *6K 



y/2f{z)nh\ogil/h) 



< (27) 
g 



To prove this, we introduce some parameters that will be properly adjusted in 
the sequel. Recall that a > appears in (4). Let 7 > 0, p > I and < S < a/A 
be real numbers. We shall invoke some usual blocking arguments along the 
subsequence rifc := [(1 +7)^^], fc > 1. For fixed k > 1, consider the following 
discretisation of f)nfc_i]- 

hn,M^, [)nfc-i, hn,d := p'^hn,, Z = 0, . . . , i?fe - 1 , (28) 

where := [log((]„^._j//7.„j^)/ log(p)] + 1, and [u] denotes the only integer q 
fulfilling q < u < q + 1. Since /i„ and l)„ satisfy (HV1)-(HV3), the triangular 
array hn^^i, < I < Rk satisfies the two following properties that will play a 
crucial role in our arguments (see our key argument 1 below) . 

lim max /i„. ; — (29) 

fc->oo 0<l<B.k 

lim min - — ,^ , = cx3. (30) 

i;-*oo Q<l<B.k l0g(l//l„j^,;) 

Recall that := [0, 1]''. For each < I < Rk, we proceed as in Mason (2004), 
covering H by pairwise disjoint hypercubes written as 

Tfc.ij := {zk,u + [0, (<5V,i ^<J<Ji, (31) 
with Zfc G H. Since < i5 < a/4, we have, for all fc > 1 and < I < Rk, 

Ji 

c y r,,,,, C i?"/^ (32) 

Notice that by construction: 

Ji < k>l,0<l<Rk, (33) 

where C := C{S) depends on (5 > and on the volume of H only. Set Nk := 
{uk-i + 1, . . . ,nk} whenever nk~i < rik, and Nk = elsewhere. For A C B{G) 
and e > we write the e neighbourhood of A as 

A' := e B{g), II - |le< e}- (^^) 
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For all large fc, we split the following probabilities in two. 



k . 



< 



U (i-f 

I. rCW 



/iG[/i„,f)„] 



u 



(2/(z)n/Uog(l//i))'/' 
Gn{-,h,z) 



> 4e 



\ neNk,zeH, ^{2f{z)nh\og{l/h)) 



1/2 



< 



u 



Gni-,hnk,l,Zk,l.j) 



KneN^,0<l<R^, ^ (2/(zfcJj>fc/l„,,il0g(l//l„,j)) 
i<j<Jl 



1/2 



max sup 

neNk,0<l<B.k-l. i<h<ph„^ 
^ l<j<Jl ^ ^r. 

Gn{', hn^,l, Zk^l.j) 



Gn{-,h,z) 



{2f{z)nh\og{l/h)) 



1/2 



{2f{zk,i,j)nkhn,j log(l//i„,,i)) 

\.k+P2.k- 



1/2 



> 2e 



(35) 



Our aim is to prove that Pi jt and P2.A: are both summable in k, which would 
prove part (i) of Theorem 1 by an application of Borel-Cantelli's lemma to Pfe. 



2.2.1. Step 1: blocking and poissonisation 



By a blocking argument that is similar to Ottaviani's inequality (see for example 
Deheuvels and Mason (1992), Lemma 3.4), we have, for fixed k > 1, I < Rk, 

i < Ji - 

G„(-, hn^.l, Zkl.j) 



u 

1 



^2e 



< 



where 



ruk 



i2fizk,u)nkK,,i\og{l/K,jW^' 

j,f Gnk{-,hn^^i,Zk,Uj) 

mfc"" \ {2f{zkd,j)nkh„^^i\og{l/h„^j)Y/'^ 

Gm{', hnf^,l, Zk,l,j) 



(36) 



mm 

l<Rk,3<Ji. 
0<m<nfc-nfc_i 



{2f{zk,Uj)nkK^j\0g{l/hn^^l)) 



1/2 



< e 



To control m^, we shall invoke an argument that will be repeatedly used in 
that article. Roughly speaking, we make use of the arguments of Mason (2004) 
replacing /i„^ by h^^^i. This leads us to consider the following classes of function, 
for A: > 1,; < Rk,j < Ji- 



k,L] 



D. Varron/In bandwidth uniform Strassen law for empirical processes 



1055 



To obtain an upper bound that holds uniformly in hn^.^i, we shall show that 
all these classes do satisfy the assumptions of Proposition 2.2 simultaneously in 
hn^,i an Zk^i.j. To prove this, assertions (29) and (30) will play a crucial role. 

Key argument 1: By Lemma 1 in Alason (2004) (Bochner's lemma), and 
by (29) we have 

sup Var(g(Zi)) < hn^j{l + Vk), 

where Wfc — > as fc oo. Notice that each Tk.i,j is uniformly boimded by 1, 
in virtue of (HK2) and (26). We now use the notations of Proposition 2.2 with 
T := 2, po = 2, (5o = 1, p = 4, n := — n^-i and the constants C, v appearing 
in assumption (HK4). Since Uk — fik-i ~ 7/(4 + 7)71^ and by both (30) and 
(29), we have, for all large k, hn^^i < C2 and 

f {rik - nk.^i)hn^A^^^ 

0<l<Rk V ^Og{l/hn^,l) ) 

( \ 
max sup I g(z) |< min 21 (rifc - nfc_i)/i„,j/log(l//i„,,0 • (37) 

0<l<Bk, geJ^k.i.j, 0<l<Bk V / 

This implies that, for all large fc, all the classes J'k,i.j do satisfy the assumptions 
of Proposition 2.2. Moreover, for 7 > small enough and for k large enough we 
have 

4i?i(«)(,ifc-nfe^i)i/2 < 

and hence 

1 /2 

max II Gjn{-,hnk,uZk,i.j) \\g> e(2f{zk,i.j)nk\og{l/hn^^i)) 

m<nfc-nfc_i 

<P( max \\T^\\r>{p + T)Di{v){2{nk-nk-i)hn,,i\ogil/hn,,i)Y^^) 
<4exp(-A2 log(4/f)„,_J). 

Therefore, for 7 > small enough and for k large enough we have > 4/2. 
Now let 

G^K, h, z) := £ 

z— 1 \ / \ / 

be the Poissonized version of G„. Here, {rjn)n>i is a Poisson random variable 
with expectation n, and independent of {Zi)i>i. Recalling that by construction, 
there exists C = C{5) < 00 such that J/ < C{5) /hn^^u I = 1, ■■■,Rk, it follows 
that, ultimately as fc 00, 



\,k < 2 V- maxi 



^ hn„i J<-h V(2/(zfc,,,,)nfc/i„,,,log(4//i„„0)'^' 
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=:45^-— maxP,,,,,. (39) 

The last inequality is a consequence of usual poissonization inequalities (see, 
e.g., Gini ct al. (2003), Lemma 2.1). 

2.2.2. Step 2: A uniform large deviation result 

In order to control the Pj. ; j uniformly in I and j, wc shall establish a uniform 
large deviation principle that is stated in the next proposition. Recall that J 
has been defined in (3). Some routine analysis shows that J is a rate function 
on B{g). 

Proposition 2.3. Let {nk)k>i be a strictly increasing integer-valued sequence 
and {^Zk,i.j) f.y^ i^ji <j a triangular array of points belonging to H. Under 
(HV1)-(HV3) and (HK1)-(HK5), the triangular array 

Gn^i-, hn^J, ZkJj) 



1/2 / 

{2f(zk,uj)nkK^^j\og{l/K^^i)) y k>i,i<Rk,j<J, 

satisfies the ULDP for the rate function J and the triangular array 

Ck.Lj := [logil/ hn„i))-\ k>l,l<Rk,j< Ji. 

Proof. To prove Proposition 2.3, we shall make use of Proposition 2.1, and 
we hence have to check conditions 1, 2 and 3 of that theorem. Compared to 
Proposition 1 of Mason (2004), the present proposition adds a uniformity in 
hnk,i- Checking condition 2 of Proposition 2.1 readily follows the lines of the 
proof of Mason according to the following remarks: We can apply his Fact 2 
with an additional uniformity in hn^^i, as ()„ — + and hence Bochner's lemma 
still holds uniformly in hnf.^i. We can also apply his Fact 3, replacing /i„ by hn^^i- 
Hence, his assertion (4.16) still holds replacing /i„ by hn^j^ with an additional 
uniformity in h^^ i. Now define the following distance on Q. 



d^{K,K') -.^ J {K-K'f{z)dz. 



It remains to show that for any Af > 0, a > 0, there exists 5 > fulfilling 
lim sup max ; , 

l<j<Ji 

Gn^jK, hn^^i,Zkdj) - Gnk{K',hn^^l,Zk,lj) \ \ 

oUJj _ ^ I I 

K.,K'eg,_ y^2f{zkJ,j)hn,j\0g{l/hn,,l) J J 

d{K,K')<S 

(40) 
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So as conditions 1 and 3 of Proposition 2.1 would be checked. Choose M > 
and a > arbitrarily. For each A: > 1, < Z < i?^;, 1 < j < and S > 0, consider 
the following class of functions: 



(f{K,K') < S 



Let Di(2ti) be the as in Proposition 2.2 (recall that f > appears in assumption 
(HK4)). We have, for any fc > 1, < Z < 1 < j < Ji, 



sup 

d{K,K')<S 

Grik ('i hn^J, Zk,l,j) 



(2nkK^^i\og{l/hn^^i)) 



yj2f{zkjj)K^^i\og{l/K^j) 

> 2Di{2v)a 



> 2Di{2v)a 



1/2 



E 



,U ZkJ.j) 



< 



max 

m— 1 2nu 



1 /2 

{2nkhnt,,i log(l//i„^,i)) 



> 2i:»i(2w)a 



.1/2 



> 2Di{2v)a 



iog(i/v,0)) 

+ P{r]n, > 2nk) 

^■^k,Lj,l + Pk,Lj,2. 

By Chernoff 's inequality we have 

^kd.j,2 < exp(-(21og2- l)nfc), 0<l<Rk, 1 < j < Ji- 
By (HK4) we have, by simple arguments, 



'-:C' 



< e < 1. 



(41) 



(42) 



(43) 



An application of Lemma 1 in Mason (2004) in combination with (29) leads to 
the following inequality, for all large k: 



max sup h ,Var n 



Zi — Zk,i.j 



< 25 



(44) 



Reasoning as in the key argument 1, we conclude that, for all large fc, each class 
^ki]^^ < / < i?fc, 1 < j < do fulfill conditions (20), (18) and (19) of 

Proposition 2.2 with po := a, V2^, 5q :— 2, p := 4, n := 2nk and C ,v' 

appearing in (43). Applying Proposition 2.2, we get, for all large k and for each 
0<?<i?fc, l<i<Ju 
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<P( max 

\ m— 



max 1 1 T„ 1 , _> £»! [v') {a + ViS) J2nkf{zk.i,j)K,,i\og{l/K,,i) 



a2 



<4exp(^-A2^1og(l//i„,,)j- (45) 

Notice that (45) is true for all 5 > satisfying 26 < a. By (42) in conjunction 
with (45), we have for (5 > small enough, ultimately as /c — *■ oo, 

Pfcjj <4exp(-Mlog(l//i„,j)) +exp(-(21og2-l)nfc) 
<5exp(-Mlog(l//i„,j))- 

This shows that (40) is true. We now refer to Arcones (200), Theorem 4.2, for 
the proof of the fact that 

sup Jifi,....K,(*(ifi), . . . ^{Kp)) = J(*), 

p>i, {Ki,....Kp)egp 

which completes the proof of Proposition 2.3 by an application of Proposi- 
tion 2.1. □ 



2.2.3. Step 3: summability o/Pi,fc 

For fixed e>0,(5>0,p>l and for 7 > small enough, we apply Proposi- 
tion 2.3 to the following closed subset of (yS(tJ), || • \\g ). 

:= l^- e S(g), inf || ||(j> e|. 

L *'eK J 

Key argument 2: By lower semicontinuity of J on {B{Q), II ' He )j there exists 
ai > such that J{Ff) = 1 + 2q;i. Hence, inequality (39) becomes 



<4^- exp(-(j(F,) -«i)log(l//i„„0 



l,k 

1=0 

<AcY,K,,r< 4CKiY,p'^^'< ^^Kip"'^"""-'^- 
1=0 1=0 ^ 

Recall that C > depends only on i5 > and H. Since we have by construction 
Rk < log(f]„j^_^/ft.„J/log(p) -I- 1, we deduce that 



4Cp2"i 

7° 



But (HV3) ensures that i)nl-i summable, which in turn implies that(Pfc_i)fc>i 
is widely summable in fc, whatever the choice of (5 > 0, p > 1 and 7 > 0. 
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2.2.4- Step 4- o,n upper bound for ¥2,k 

Now for an arbitrary e > wc shall adjust 5 > and p > I such that, for 7 > 
small enough, the sequence P2,fc has a finite sum in k. We start by the following 
decomposition. 



■ 2,k 



max sup 



Gn{-,h,z) 



i<]<Ji 



Gn{'i hnk,l: ^k,l,j) 



{2fizk,i,j)nkhnk,i log(l//^„„0)i/2 



{2f{z)nh\og{l/h)y/^ 



> 2e 



< P max sup 

\neNk,0<l<Rk-l. /i„ ,<h<ph„^ ,. 



G„(-, /l, z) — Gn{-,hnk,l, Zkdj) 



+ P max sup Bk.n,h. 

\neNkd<Rk-l: h„, i<h<ph„, I, 
= :P2.1,fe+P2,2.fc, 

Here we have set, for z e ^k.j,h 



\/'2f{zk,L3)nkhnk,l^Og{l/hnk,l) 

G„(-,/i, z) 



y^2f{z)nkhnk,li0g{l/hnk) 



> e 



> e 



-^k,n.h,z 



' 2f{zk,i,j)nkKkj\og{l/Kk,i) ^ 
2f{z)nh\og{l/h) 



(46) 



In order to control P2,2,fe, we make the following decomposition for all large k: 



^2.2,k < ^ P2,2,A:,ij-, 

0<l<Rk-l, 
l<]<Ji 



where 



^2,2,fc,i J := P max sup Bk,n,h,. 

zeTk.i,, 



G„(-,/i, z) 



^ f{z)nkh\og{l/K^j) 



> € 



Some usual analysis based on (H f), (29), (30), and — nk~i ^ nk~i^/{l + 7) 
show that, for any choice of 5 > 0, p > 1 small enough we have, for all large k: 

max sup Bk,n.h,z < 7(1 + 27) + 27- (47) 

nSAffc, l<Rk, i<h<ph„^,i, 
zeFk.i., 

Hence, for any choice of 7 > small enough, we have (recall Proposition 2.2 
and assumption (HV4)) 



hminf inf eB^^n,. > ^Mv)- 

h„k<h<t)'^k-l 



(48) 
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Now consider the following classes of functions: 

By (29) and Lemma 1 in Mason (2004) we have, for all large k: 

max sup /i-i,Var(/(Zi)) <4. (49) 

Recall (26). According to (HK4) we have 

Proceeding similarly a in the key argument 1, we infer that all the classes 
'^k,i,j, < I < Rk, I < j < Ji do satisfy conditions (20) (18) and (19) in 
Proposition 2.2, with r -\/^ A 1, p 2, Sq = 2, p = 4, n := nk, h := /int,;, 
C" and V. Making use once again of Proposition 2.2, and assuming that 7 is small 
enough to fulfill (48) we get that, for all large k and < I < Rk, 1 < i < Ji, 



^2.2,fc,;.j <P max || T„ |b > ADi{v){2nk\og{l/h„,.i)) 



1/2 



1/2 



<P max ||T„|b > Di{v){t + p){2nk\og{l/K,.i)) 
<4exp(^-^2^ log(l//i„,j) 

Hence, proceeding as in key argument 2 we get, ultimately as fc — > cx), 

4C 

0</<_Rfc-l, l<j<Ji ^ 

whence (P2,2,fe) is summable by (HV3). 

By making use of similar arguments, it can be proved that, for a suitable 
choice of p > 1 and 5 > Q small enough, we have 

^P2,i,fc<cx3. (50) 
fc>i 

This result is proved by considering the classes 

^k„i ■■=[fi^^-i^^r'''{i<{j;^^ 

hn^,i < h < phn^^i, Keg 
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and showing by {HVl) that, given e > 0, one can choose p > 1 and 5 > small 
enough to fulfill sup{Var(5(Z)) , g ^ T'j, ^ < ehn^.i uniformly in j and I. We 
omit details for sake of brievness. □ 

Remark: 

A close look at the proof of part (i) of Theorem 1 shows that assumption (HK3) 
can be relaxed to the following assumption: 

{HK3') 3M > 0, e g, y-x i [0, MY, K{x) = 0. 



2. 3. Proof of part (ii) of Theorem 1 



Since K is a compact subset of {B{Q), || • ||g ), it is sufficient to show that for 
fixed 5* e K and e > we have almost surely 



lim sup inf 



G„(-,/i, z) 



^2f{z)nh\og{\lh) 



< 4e. 



Choose an open hypercube H' C H such that ¥{Zi E H') < 1/2. Such a choice 
is possible because H has a nonempty interior by assumption. Let 1 < p be a 
parameter that will be fixed later. Consider the net 

/i„,i :=p'/i„, Z = 0, . . . ,i?„ - 1, /i^-^^ :=[)„, (51) 
i?„ :=[log(f)„//i„)/log(p)] + l. (52) 

For fixed I < i?„ we divide H' into disjoint hypercubes 

r„j,i = Zn,l.j + [0, hn/^'^ f. 

Note than we can construct J; := C/hn i disjoint hypercubes. where C depends 
only on the volume of H' . 



2.3.1. Step 1 

We shall first show that for any choice of p > 1 we have almost surely 



lim sup sup inf 

0<l<Rr 



{2f{z)nK,i\og{l/Kj)) 



1/2 



< e. 



(53) 



Recall that G'„(-, /i, z) denotes the "poissonized" version of Gn(-, ft., z) (see (38)). 
By making use of poissonization techniques (see, e.g.. Mason (2004), Fact 6), 
we have, ultimately as rt ^ oo. 



max inf 



Gn{', hji^i, z) 



{2f{z)nhn,ll0g{l/hn,l)) 



1/2 



- * 



> e 
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/ Ji 

<2$:p(n 



{2f(Zn,lj)nhnj log(l//i„,i)) 



1/2 



- ^ 



> e 



1=0 



But (HK3) entails that, for fixed / < j < Ji, the events Enjj are mutually 
independent (by classical properties of Poisson random measures) , whence 



(n^"^'.j) = lii'^-HEZu)) < cxp(-J,minP(i?; 



From Proposition 2.3 and by lower semi continuity of J we deduce that, for 
some a > and for all large n we have 



J 

o<;<fi„, i<j<Ji 



Hence, ultimately as — s- cx), 



< y^^exp(-Jihn/ 



1=0 



< 1 



log(t)„//i,„) 
log(p) 



exp 



C 



Assumptions (HV2) and (HV3) readily imply that P„ has a finite sum in n, 
which proves (53) by the Borel-Cantelli lemma. 



2.3.2. Step 2 



It remains to show that, for any e > 0, one can choose p > I small enough to 
have almost surely 



lim„^oo max sup 

1<R„ zeH, 

hnj <~h<.phnj 



Gn{-,h,z) 



{2f{z)nhn,i\og{l/hn,i)) 



{2f{z)nh\og{l/h)) 
< 3e. 



1/2 



1/2 



(54) 
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Wc set, for p' > 1 and x e M'^, Kp>{x) := K (p' ^/''x). Hence, setting p' = 
p'{h,n) := h/hn.i G and u' u'(h,n) := (log{l/h)) ^, we have almost 

surely, for each < / < i?„ and h E [hn.i, phn.i] and K E Q, 



hn,ilog{l/h„,i) 



1/2 



Gn{Kpi,hn,Uz) 



{2f{z)nh\og{l/h)f'^ V /ilog(l//i) ; {2f{z)nKM^/hn,i)y'^ 



a{p,u) 



{2f{z)nK,i\og{l/Kj)Y'^ 

Gn(Kp',hn,l,z) 



(2/(z)n/i„,,log(l//i„,0) 



1/2- 



(55) 



Consider the class 

g' := {i^^. Keg, l<p<2}. 

Clearly, g' satisfies (HKl), (HK2), (HK3') and (HK4)-(HK5). By applying part 
(i) of Theorem 1, wc have almost surely 



lim sup sup inf 

n-foo /i„</i<f)„, *6Kg/ 



1'„(-,/i,z)-* 



G' 



(56) 



where Kg> is as compact subset of (^B{g'), || • ) and hence satisfies 

lim sup sup sup I q;(p', u')*(-^V) ^ *(^) 1^ ^- (^7) 

u-»0, pil *gKg, l<p'</3, KeG 
0<u'<u 

Now combining (55), (56) and (57) leads to (54), provided that p > 1 has 
been chosen small enough. The proof of part (ii) of Theorem 1 is concluded by 
combining (54) and (53). 
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